A framework for evaluating contextual understanding
نویسندگان
چکیده
In this paper we propose and describe a framework for evaluating and diagnosing the understanding component of a spoken dialog system which can be applied to both literal and contextual understanding. We have observed in a previous experiment that contextual understanding performance is strongly correlated to the user satisfaction. The framework uses a glassbox approach to diagnose the interpretation modules. Results are given on a 1681 literal understanding test set and 100 contextual understanding test set.
منابع مشابه
A Contextual Method for Evaluating Privacy Preferences
Identity management is a relevant issue at a national and international level. Any approach to identity management is incomplete unless privacy is also a consideration. Existing research on evaluating an individual’s privacy preferences has shown discrepancies in the stated standards required by users, and the corresponding observed behaviour. We take a contextual approach to surveying privacy,...
متن کاملPolicy, Theory, and Evaluation: Stop Mixing the Fruit Salad; Comment on “Developing a Framework for a Program Theory-Based Approach to Evaluating Policy Processes and Outcomes: Health in All Policies in South Australia”
The study of Health in All Policies (HiAP) is gaining momentum. Authors are increasingly turning to wide swathes of political and social theory to frame (Program) Theory Based (or Informed) Evaluation (TBE) approaches. TBE for HiAP is not only prudent, it adds a level of elegance and insight to the research toolbox. However, it is still necessary to organize theoretical thinking appropriately. ...
متن کاملDeveloping a framework for studying and evaluating the types of psychological contracts in the context of relationship marketing
Nowadays, belief in the criteria and conditions of interactions with an organization to promote customer relationships is somehow tied to the organizational performance, and its final goal is of great importance. In the literature on organizational behavior, this belief is defined as the “psychological contract”. The intention of this mixed research is to identify and discover the contents of p...
متن کاملA conceptual framework of contextual factors affecting knowledge transfer using meta-synthesis method
Since knowledge is currently considering as one of the most critical resources in organizations, knowledge management has an essential role in organizational success. Recently knowledge transfer has become a fast, growing, innovative, and essential research theme in the management domain. This paper proposes a comprehensive framework to have effective knowledge transfer in projects, especially ...
متن کاملChoosing appropriate theories for understanding hospital reporting of adverse drug events, a theoretical domains framework approach
Adverse drug events (ADEs) may cause serious injuries including death. Spontaneous reporting of ADEs plays a great role in detection and prevention of them, however, underreporting always exists. Although several interventions have been utilized to solve this problem, they are mainly based on experience and the rationale for choosing them has no theoretical base. The vast variety of behavioral ...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2000